Analogical Reinforcement Learning
نویسندگان
چکیده
Research in analogical reasoning suggests that higher-order cognitive functions such as abstract reasoning, far transfer, and creativity are founded on recognizing structural similarities among relational systems. Here we integrate theories of analogy with the computational framework of reinforcement learning (RL). We propose a computational synergy between analogy and RL, in which analogical comparison provides the RL learning algorithm with a measure of relational similarity, and RL provides feedback signals that can drive analogical learning. Initial simulation results support the power of this approach.
منابع مشابه
Reinforcement Learning with Analogical Similarity to Guide Schema Induction and Attention
Funding information This work was supported by AFOSRGrant FA-9550-10-1-0177 toMatt Jones. Research in analogical reasoning suggests that higher-order cognitive functions such as abstract reasoning, far transfer, and creativity are founded on recognizing structural similarities among relational systems. Here we integrate theories of analogy with the computational framework of reinforcement learn...
متن کاملLearning and Transfer: A General Role for Analogical Encoding
Teaching by examples and cases is widely used to promote learning, but it varies widely in its effectiveness. The authors test an adaptation to case-based learning that facilitates abstracting problemsolving schemas from examples and using them to solve further problems: analogical encoding, or learning by drawing a comparison across examples. In 3 studies, the authors examined schema abstracti...
متن کاملAnalogical Learning in a Turn-Based Strategy Game
A key problem in playing strategy games is learning how to allocate resources effectively. This can be a difficult task for machine learning when the connections between actions and goal outputs are indirect and complex. We show how a combination of structural analogy, experimentation, and qualitative modeling can be used to improve performance in optimizing food production in a strategy game. ...
متن کاملInstance-Based Online Learning of Deterministic Relational Action Models
We present an instance-based, online method for learning action models in unanticipated, relational domains. Our algorithm memorizes preand post-states of transitions an agent encounters while experiencing the environment, and makes predictions by using analogy to map the recorded transitions to novel situations. Our algorithm is implemented in the Soar cognitive architecture, integrating its t...
متن کاملLearning Conceptual Hierarchies by Iterated Relational Consolidation
Learning new concepts is critical to making sense of the world. Research on analogical reasoning suggests structure mapping and schema induction can enable discovery of new relational concepts. However, existing theories of schema induction and refinement are insufficient to explain acquisition of rich, compositional hierarchies of relational concepts. This paper offers a proposal for this sort...
متن کامل